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- The MAILING DATE of this communication appears on the cover sheot with the correspondence address - 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 



- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply Is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply witfiin the set or extended period for reply wilt, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 



3) n Since this application is in condition for allowance except for fomnal matters, prosecution as to the merits is 

closed in accordance with the practice under £x parte Quayle, 1935 CD, 11, 453 O.G. 213. 

Disposition of Claims 

4) 13 Claim{s) 1-36 is/are pending in the application. 

4a) Of the above claim(s) 21-33 is/are withdrawn from consideration. 

5) 13 Claim(s) 34-36 is/are allowed. 

6) M Claim(s) 1, 3-20 is/are rejected. 

7) 13 Claim(s) 2 is/are objected to. 

8) n Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) 0 The specification is objected to by the Examiner. 

10)0 The drawing(s) filed on is/are: aO accepted or b)n objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 

Replacement drawing sheet{s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 
1 !)□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or forni PTO-152. 

Priority under 35 U.S.C. § 119 

12)^ Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 
bM All b)n Some * c)^ None of: 

1 .IE Certified copies of the priority documents have been received. 

2. n Certified copies of the priority documents have been received in Application No. . 

3. n Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 



Status 



2sM 



Responsive to communication(s) filed on 1/13/2005 . 

This action is FINAL. 2b)n This action is non-final. 
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DETAILED ACTION 

1. This action is responsive to communications: amendment filed 1/13/2005, to the original application 
filed 6/24/1998, with provisional application filing dates of 9/22/1997, and 6/25/1997. AppHcant swears behind 
the date of 6/10/1997. 

2. The examiner acknowledges Applicant's election of Group I (claims 1-20), filed 5/7/2004 with traverse. 
It is respectfixUy noted that since Applicant provides no argument in support of traverse, the examiner interprets 
this as an election without traverse. 

3. Claims 1, 3-4, 6, 8 remain rejected under 35 U.S.C 103(a) as being xuq)atentable over Venkatraman and 
Hanson. 

4. Claims 5, 7 remain rejected under 35 U.S.C. 103(a) as being unpatentable over Venkatraman, Hanson, 
and Reber. 

5. Claims 9-20 remain rejected under 35 U.S.C. 103(a) as being unpatentable over Venkatraman, Hanson, 
and Suzuki. 

6. Claims 1-36 pending. Claims 21-33 remain withdrawn from examination on the merits. Claims 34-36 
have been added Claims 1,16, 20, 34 are independent clainns. 

Allowable Subject Matter 

7. Claims 34, 35, 36 are allowed. 

8. Claim 2 is objected to as being dependent upon a rejected base claim, but would be allowable if 
rewritten in independent form including all of the limitations of the base claim and any intervening claims. 
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Claim Rejections - 35 USC § 103 

9. The following is a quotation of 35 U.S.C 103(a) which forms the basis for all obviousness 
rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in section 102 of this title, if the 
differences between the subject matter sought to be patented and the prior art are such that the subject matter as a whole would have been 
obvious at the time the invention was made to a person having ordinary skill in the art to which said subject matter pertains. Patentability shall 
not be negatived by the manner in which the invention was made. 

10. Claims 1, 3-4, 6, 8 are rejected under 35 U.S.C 103(a) as being unpatentable over Venkatraman et 
al (hereinafter Venkatraman), U.S. Patent No. 5,956,487 issued September 1999, in view of Hanson, U.S. 
Patent No. 6,148,346 issued November 2000. 

In regard to independent claim 1, Venkatraman teaches a home automation network conprising an 
interface for accessing connected home devices (Venkatraman Figure 3, column 3 lines 27-33; conpare with 
claim 1 method for providing.,.. comprising the steps of). 

Venkatraman does not specifically teach a ''device list file'' associated with connected home devices. 
However, Hanson teaches a GUI displaying an object Kst (file) of available network devices (Hanson Figure 5, 
column 5 lines 36-40; compare with claim 1 ''generating a device list file. ...wherein the device list file identifies 
home devices that are currently connected to the home networlc \ and "identified in the device list file''). It would 
have been obvious to one of ordinary skill in the art at the time of the invention to apply Hanson to 
Venkatraman's web page generation, because of Hanson's taught advantage of itemizing, so as to provide 
Venkatraman the benefit of indicating to a user all available devices on a network (a conplete list). 

Venkatraman teaches accessing connected home devices using Web technology so that access is 
independent of an operating system platform and browser software, as well as independent of the location of the 
user (Venkatraman column 2 lines 36-42). Venkatraman also teaches generating a web page dynamically to 
reflect the updated state of the information pertaining to a device maintained by a monitor (Venkatraman 
column 3 lines 33-36), suggesting autonomous generation since it is dynamically updated without user help, 
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providing the benefit of automatic updating to reflect changing device parameters (compare with claim 1 "... in 
an autonomous and dynamic manner''). 

Venkatraman teaches a self contained home network conprising inter-communication links and a web 
browser enabling communication with a set of devices (Venkatraman Figures 2, 3, column 3 lines 33-40, 
column 5 lines 29-40, 46-5 1; compare with claim 1 ''creating a device link page''). Venkatraman also teaches a 
textual representation of a corresponding connected device (a printer name) (Venkatraman Figure 3 item Printer 
Name, Portdv9; compare with claim 1 '"at least one graphical or textual representation of corresponding 
devices"). 

Venkatraman teaches a set of user interface functions written in HTML, said functions associated with a 
device on a network (Venkatraman Figure 3, column 5 lines 36-42; conpare with claim 1 ''associating a hyper- 
text link with each device representation.., Jhat is associated with the device representation"), Venkatraman also 
teaches a Web page contained in the associated device (Venkatraman Figure IB items 10, 18, which is 
indicative of device item 10 in Figure 2; compare with claim 1 "contained in the device"). 

Venkatraman teaches display of device information on a network browser (Venkatraman Figure 3; 
compare with claim 1 "displaying the device link page on a browser based device"). 

In regard to dependent claim 3, Venkatraman teaches a home device cormected to a home network, as 
well as a link page. Venkatraman does not specifically teach associating/retrieving a logical name stored in a 
device link file, as well as icons. However, Hanson teaches a hsting of available devices, each device 
conprising a logical name (i.e. HDE/Meister, HDE/Gerry), to which a device is user selected and is represented 
by various GUI buttons associated with a status icon (Hanson Figures 3-5, column 5 lines 25-40; conpare with 
claim 3). It would have been obvious to one of ordinary skill in the art at the time of the invention to apply 
Hanson to Venkatraman, because of Hanson's taught advantage of user selection, providing Venkatraman a way 
to customize a home network. 
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In regard to dependent claim 4, Venkatraman teaches a home device connected to a home network, as 
well as a link page. Venkatraman does not specifically teach associating/retrieving a logical name stored in a 
device link file, as well as icons. However, Hanson teaches a listing of available devices, each device 
conprising a logical name (i.e. HDE/Meister, HDE/Gerry), to which a device is user selected and is represented 
by various GUI buttons associated with a status icon (Hanson Figures 3-5, column 5 lines 25-40; con5)are with 
claim 4). It would have been obvious to one of ordinary skill in the art at the time of the invention to apply 
Hanson to Venkatraman, because of Hanson's taught advantage of user selection, providing Venkatraman a way 
to customize a home network. 

In regard to dependent claim 6, Venkatraman teaches a home based network enabling a web browser 
to access user interface functions via URL's, said URL's can be embedded within an appliance 
(Venkatraman column 5 lines 29-42, column 8 lines 1-8; conpare with claim 6). 

In regard to dependent claim 8, Venkatraman teaches a method whereby web server queries a device, 
and in response, the targeted device transfers an HTML file that defines its device web page 
(Venkatraman column 7 lines 37-46; con5)are with claim 8). 

11. Claims 5, 7 are rejected under 35 U,S.C 103(a) as being unpatentable over Venkatraman and 
Hanson as applied to claim 1 above, and further in view of Reber et al. (hereinafter Reber), U-S. Patent 
No. 5,398,726 issued August 1999. 

In regard to dependent claim 5, Venkatraman teaches a user defined area (Venkatraman Figure 3). 
Venkatraman does not specifically teach a method of receiving a device logo fi"om a home device. However, 
Reber teaches a method of displaying a graphical logo relating to a device onto a browser screen (Reber Figure 
3; conpare with claim 5). It would have been obvious to one of ordinary skill in the art at the time of the 
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invention to apply the logo method of Reber to the list and button GUI of Venkatraman/Hanson, because of 
Reber's taught advantage of graphical logos, providing increased device recognizability to the method as taught 
by Venkatraman/Hanson. 

In regard to dependent claim 7, Venkatraman teaches a user defined area (Venkatraman Figure 3). 
Venkatraman does not specifically teach a method of receiving a device logo fi'om a home device. However, 
Reber teaches a method of displaying a graphical logo relating to a device onto a browser screen (Reber Figure 
3; conpare with claim 7). It would have been obvious to one of ordinary skill in the art at the time of the 
invention to apply the logo method of Reber to the list and button GUI of Venkatraman/Hanson, because of 
Reber's taught advantage of graphical logos, providing increased device recognizability to the method as taught 
by Venkatraman/Hanson. 

12. Claims 9-15 are rejected under 35 U-S.C. 103(a) as being unpatentable over Venkatraman and 
Hanson as applied to claim 1 above, and further in view of Suzuki et al. (hereinafter Suzuki), 
Teleoperation of multiple robots through the Internet, IEEE Robot and Human Communication, 
November 11-14, 1996, pp. 84-89. 

In regard to dependent claims 9, 10, 11, Venkatraman does not specifically teach updating device list 
files as devices are connected and/or disconnected However, Suzuki teaches operation of devices via the 
Intemet, whereby calls are made to robots. All robots that respond (or indicate they are busy) are obviously 
connected, and the system makes note of the robots which do not return replies (i.e. disconnected, or broken 
etc.) (Suzuki page 87 left column item 8, also page 88 section 5.3 "An Examination of Teleoperation"). It would 
have been obvious to one of ordinary skill in the art at the time of the invention to apply Suzuki to Venkatraman, 
Providing Venkatraman the benefit of keeping track of devices. 
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In regard to dependent claim 12, Venkatraman teaches network location of a device (Building lU), 
(Venkatraman Figure 3 item 64). Venkatraman does not specifically teach availability of connected devices. 
However, However, Suzuki teaches operation of devices via the Internet, whereby calls are made to robots. All 
robots that respond are obviously connected, and the system makes note of the robots that indicate they are busy 
(Suzuki page 87 left column item 8, also page 88 section 5.3 "An Examination of Teleoperation"). It would have 
been obvious to one of ordinary skill in the art at the time of the invention to apply Suzuki to Venkatraman, 
Providing Venkatraman the benefit of keeping track of devices. 

In regard to dependent claims 13, 14, 15, Venkatraman does not specifically teach updating device list 
files as devices are connected and/or disconnected. However, Suzuki teaches operation of devices via the 
Internet, whereby calls are made to robots. All robots that respond (or indicate they are busy) are obviously 
connected, and the system makes note of die robots which do not return repUes (i.e. disconnected, or broken 
etc.) (Suzuki page 87 left colvunn item 8, also page 88 section 5.3 "An Examination of Teleoperation"). It would 
have been obvious to one of ordinary skill in the art at the time of the invention to apply Suzuki to Venkatraman, 
Providing Venkatraman the benefit of keeping track of devices. 

13. Claims 16-20 are rejected under 35 U.S.C. 103(a) as being unpatentable over Venkatraman in 
view of Hanson, and further in view of Suzuki. 

In regard to independent claim 16, claim 16 incorporates substantially similar subject matter as 
claimed in independent claim 1, and in fiuther view of the following, is rejected along the same rationale. 

Vekatraman does not specifically teach menu creation for selecting devices as presently claimed. 
However, Suzuki teaches a browser device interface depicting images ft^om two robot devices in a room Suzuki 
also teaches a "Dialogue Window" for entering commands to a particular device identified via identifiers 
(Suzuki page 87 Figure 4, also column 2 near middle - "**CmCdOr', and page 88 Figure 6). In addition, Suzuki 
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teaches presentation of images from each connected robot, along with a "Dialogue Window" for inputting 
commands directed to specific devices (Suzuki Figure 4), therefore indicative of a menu selection presentation 
(compare with claim 16 ''creating a menu page, the menu page containing at least one of a graphical and/or 
textual representations of said home devices that are currently connected to said home networfc'). It would have 
been obvious to one of ordinary skill in the art at the time of the invention to apply Suzuki to visualize 
Venkatraman's device list file, providing a user of Venkatraman the benefit of comparing and contrasting 
robotic characteristics for aiding in a user's eventual decision. 

In regard to dependent claim 17, Venkatraman teaches a user interface device for presentation of a 
home page with selectable urls (Venkatraman Figure 3). 

In regard to dependent claim 18, Venkatraman does not specifically an image icon with a graphical 
representation of a home device. However, Hanson teaches a listing of available devices, each device 
con:q)rising a logical name and associated with an image (Hanson Figures 3-5). It would have been obvious to 
one of ordinary skill in the art at the time of the invention to apply Hanson to Venkatraman, because of 
Hanson's taught advantage of user selection, providing Venkatraman a way to visually customize a home 
network. 

Venkatraman does not specifically teach said image file originating fi*om a home device. However, 
Suzuki teaches images originating from each robot device connected to a network (Suzuki page 87 Figure 4, 
page 88 Figure 7). It would have been obvious to one of ordinary skill in the art at the time of the invention to 
apply Suzuki to Venkatraman, providing Venkatraman the benefit of visually displaying representative images 
originating from connected devices. 

In regard to dependent claim 19, Vekatraman teaches a logical device name (Venkatraman Figure 3 
"Portdv9"). Venkatraman also teaches embedding web access in an appliance, whereby access to user interface 
functions for a device is attained through a device web page located within said device, said page activated via 
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hyperlink (Venkatraman Abstract, also column 3 lines 17-25, 28-50), which is an indication of an DP address 
associated with said device. 

In regard to independent claim 20, claim 20 incorporates substantially similar subject matter as 
claimed in independent claim 16, and is rejected along the same rationale. 

Response to Arguments 

14. AppUcanfs arguments filed 1/13/2005 have been fully and carefully considered but they are not 
persuasive. 

Applicant argues that the Office Action states that Venkatraman does not teach autonomously and 
dynamically identifying and locating devices. It is respectfully noted that Venkatraman teaches a dynamically 
updated Web page for devices, including control buttons for controlling device functions. Displaying printers 
that are available can be reasonably interpreted as currently connected. Additional support can be found in 
Hanson Figures 3, and 4, which shows an option for selection of available printers over a network. Figure 3 also 
shows a printer status button, providing a reasonable suggestion to the skilled artisan, current connectivity of 
devices, since a printer must be coimected in order to ascertain its status (i.e. Figure 4, "IDLE"). 

AppUcant argues that Hanson shows a GUI list of available printers, not a device list file that identifies 
home devices currently connected to a network. The examiner notes that showing printers that are available can 
be reasonably interpreted as currently connected Additional support can be found in Hanson Figures 3, and 4, 
which shows an option for selection of available printers over a network. Figure 3 also shows a printer status 
button, providing a reasonable suggestion to the skilled artisan, current connectivity of devices, since a printer 
must be connected in order to ascertain its status (i.e. Figure 4, "IDLE"). 

Applicant additionally argues that Applicant's claimed device link file includes logical device names, as 
opposed to Hanson's cited teaching. The examiner notes that Hanson teaches a listing of available devices, each 
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device coii5)rising a logical name (i.e. HDE/Meister, HDE/Gerry). In additional support of the instant rejections, 
Venkatraman teaches a Printer Name "Portdv9", which can be reasonably interpreted as a logical device name. 
Since Venkatraman also teaches a dynamically updated Web page for devices, including control buttons for 
controlling device functions (Venkatraman column 3 lines 33-40), said Web page generally con5)rises an 
HTML file containing at least code for presentation, therefore, Hanson's object list file can be added to 
Venkatraman's HTML file and resulting page. 

Applicant argues that Venkatraman does not teach a hypertext link associated with each device 
representation. The examiner notes that Venkatraman teaches links (Venkatraman column 5 lines 39-40), as well 
as links associated with a device on a Web page (Venkatraman Figure 3 items 66-68), 

Applicant argues that there is no suggestion fi*om either reference that they be combined or modified as 
proposed by the Office Action. The Examiner notes that Venkatraman teaches embedding Web access in an 
appliance for user interface functions utihzing a Web browser and Web page, for the purpose of accessing user 
interface functions through said page (Venkatraman Title and Abstract). Although Venkatraman does not 
specifically teach a device link file, Hanson teaches a dynamic device driver utilizing the Internet, and a WWW 
server, allowing for two-way commimication between peripheral devices and an operating system (Hanson 
Figure 1 items 30, 36, also item WWW Server). Hanson teaches a status monitor object which displays a GUI 
object list (a device link file) of available devices (printers) for user selection (Hanson column 5 lines 35-43). In 
support of the Examiner's rejection, Hanson itemizes its devices via a presented list, providing Venkatraman 
with an itemized list of devices. This allows a user to easily see all connected devices. 

Applicant argues that Reber does not teach the claimed limitations, and that there is no motivation to 
combine Reber with Venkatraman/Hanson. The Examiner notes that Venkatraman teaches a user defined area 
(Venkatraman Figure 3). Venkatraman does not specifically teach a method of receiving a device logo fi-om a 
home device. However, Reber teaches a method of displaying a graphical logo relating to a device onto a 
browser screen (Reber Figure 3). It would have been obvious to one of ordinary skill in the art at the time of the 
invention to apply the logo method of Reber to the list and button GUI of Venkatraman/Hanson, because of 
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Reber's taught advantage of graphical logos, providing increased device recognizability to the method as taught 
by Venkatraman/Hanson. 

Conclusion 

15. THIS ACTION IS MADE FINAL. AppHcant is reminded of the extension of time policy as set forth 
in37CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE MONTHS from the 
mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing date of this 
final action and the advisory action is not mailed until after the end of the THREE-MONTH shortened statutory 
period, then the shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no 
event, however, will the statutory period for reply expire later than SIX MONTHS from the mailing date of this 
final action. 

Any inquiry concerning this communication or earUer communications from the examiner should be 
directed to William L. Bashore whose telephone niunber is (571) 272-4088. The examiner can normally be 
reached on 1 1 :30am - 8:00pm EST. 

If attenpts to reach the examiner by telephone are unsuccessfiil, the examiner's supervisor, Joseph Feild 
can be reached on (571) 272-4090. The fax phone number for the organization where this application or 
proceeding is assigned is 703-872-9306. 
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1 6. Information regarding the status of an application may be obtained from the Patent Application 
Information Retrieval (PAIR) system Status information for published appUcations may be obtained from 
either Private PAIR or Public PAIR. Status information for unpublished applications is available through 
Private PAIR only. For more information about the PAIR system, see http://pair-direct.uspto.gov. Should you 
have questions on access to the Private PAIR system, contact the Electronic Business Center (EBC) at 866-217- 
9197 (toll-free). 
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Abstract 

This paper provides a framework for the design and 
development of personal information appliances - interactive 
technologies which aim to assist users in managing personal 
information in organisational, group and environmental 
contexts. The emphasis is on integration, both in terms of the 
development of integrated families of appliances and in terms 
of way in which appliances provide an integration of the diverse 
media necessary to support the management of personal 
information. 

Introduction: 'Personal* Computing 

There has been considerable research effort in recent years 
towards the development of innovative personal [1]» mobile [2, 
3. 4] and ubiquitous [5] computing technologies. The primary 
concern in this work is the use of advanced human interface 
techniques to allow users to bridge the gap between the 'digital 
world' and the *real world* of users' aaivities (6, 7. 8, 9]. 

These research efforts have paralleled the ways in which the 
concerns of large-scale information engineering and software 
development have - via the development of applications for 
desk-based - been rcfocuscd on the ^personal* in personal 
computing [10, 1 1]. One recent manifestation of this focus has 
been 'personalised* technology in the form of personal digital 
assistants (PDAs). The last few yean have seen several PDA 
devices appear which have targeted mobile workers who need 
to take information out of the office and into their home, car or 
around their organisations. 

Such devices, which would appear to be a valuable addition to 
users* technological armoury, have overwhelmingly failed to 
gain user acceptance, rather being seen as ^technological fixes* 
to the problem of managing information. There are at least three 
criticisms which can be levelled at such devices: 

(a) There has been little attempt to develop a body of 
knowledge and concepts regarding the nature of the process of 
managing information at a personal level. In the absence of 
such a body of knowledge the design of such technology is 
often based on prima facie assumptions about the nature of 
managing personal information, the context in which ii occurs, 
and the way in which technology can support it; 
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(b) There have been few attempts - beyond providing technical 
solutions to connectivity problems - to provide for integration 
between different technologies, and between the technologies 
and the activities they aim to support. Many current devices, far 
from being integrated into the 'global digital medium*, are only 
loosely connected with other devices which enable users to 
manage their personal information; 

(c) The conceptualisation of personal technology (in terms of 
'personal digital assistants' for example) employs metaphors 
which may be inappropriate for the possible uses (and 
limitations on the uses) of that technology. Simply developing 
mobile technology and suggesting that it is therefore 'personal* 
is not likely to be successful, either in terms of gaining user 
acceptance or in supporting the creative development of useful 
and usable devices [12]. 

Devices for managing personal information are better viewed 
as personal information appliances which are integrated into an 
'appliance family*, and which integrate several forms of user 
interaction and interface media, can serve several information 
management roles, and which are based on an understanding of 
the details of the work of managing personal information. 

A Framework for Personal Information Appliances 

The development of mass-market penonai devices and the 
effons of advanced human interface research can equally 
benefit from an organising framework in which to consider the 
development of personal devices (figure 1). The key concerns 
are (a) how such devices will integrate with each other, (b) how 
they will integrate with the existing physical enviromnem of the 
user, and (c) how they will integrate with users* 'personal 
information management' practices. 

^Personal information management* [13, 14. 15, 16] is a 
complex and varied task which requires not only the use of 
different technologies, media and modalities but the integration 
of technologies, media and modalities for information storage, 
and user input and output [17, 18, 19, 20. 21]. 

Pan of the framework for the design of personal information 
appliances is therefore a specification of the range of personal 
information management activities which are supported. These 
activities are essentially: 

1. Storage of local information created or manipulated by 
users; 

Z Retrieval of local and non-local information; 
3. Integration of multiple sources of local and non-local 
information; 

4 Decision-making by linking stored, retrieved and integrated 
information; 

5. Communication with other users and devices. 
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Figure 1 : a framework for the developmeni of infonnation 
appliances. Key factors - Practices, Technotogies, Useis 
and Integration. 



One of the problems with devices such as PDAs and the 
software applications they support is that very little 
consideration of the nature of sophisticated personal 
information management practices Hnd their way into designs 
beyond user-interface engineering considerations. Any effective 
approach to supporting the management of personal 
information will need to take account of these sophisticated 
practices as drivers for the development of technologies to 
support them. The overall aim is to make information readily 
available, connectable, easily manageable and to reduce 
redundancy. Support of personal information management 
through technology requires devices which carefully lake into 
account not only the range of activities but the links between 
those activities and the various modalities and media which can 
support them. 

The second part of this framework is a specification of users' 
experience of personal information appliances. One 
formulation of this is: 

Transparency. Access to information is transparent, and 
appliances are interchangeable; 

Appropriate information provision. The focus is not only 
on the bandwidth of information or simply multimedia 
delivery, but on the provision of information which is 
appropriate to the task at hand; 

Radically tailorable enduser interfaces. Interfaces to 
personal appliances are driven by the contextual features 
of use and the content of information [22» 23, 24, 25]; 



Multimodal interfaces. User interfaces to appliances use 
several forms of flexible multimodal presentation. 

The third basis for the organising framework is to specify the 
nature of integration. There are several senses of integration 
which are imponant to distinguish: 

The integration between various application domains of 
personal information devices: 

The integration between different types of information and 
the means by which it is manipulated. 'Multimedia 
computing' is one term that has been used to reflect the 
integration between di^crent media and modalities, but a 
better term might be multimodal technology: capable of 
being used in many modes, and providing not just multiple 
media but integrated media; 

The integration of appliances into an information 
environment. The move toward incorporating cellular 
communications and the use of removable and 
interchangeable media such as PCMCIA cards is one 
possibility, but typically this only means integration with 
other cellular or PCMCIA-enabled devices. What is 
required is an integration of the PDA imo other 
irtformarion roles and other information media. 

The fourth part of the framework is to specify enabling 
technology developments which support the development of 
appliances (figure 2): 

Communications and Network Technologies. Spectmm- 
efflcient networks, infrastructures. and equipment; the 
integration of networks and services; mobile broadband 
services; personal communications services; wireless 
personal communications networks; 

Human Interfaces. The design of information displays; 
multimodal interfaces; the use of ^digital documents'; 
open technologies for data storage and retrieval; 
video/voice integration; small and timovative display 
devices; aiKl more generally the integration of information 
media [261; 

f 

Information Engineering. Support for mobile professionals 
and knowledge/information workers; satellite offices; 
Business Process Re-Engineerihg and the virtual 
corporation; integrated office information systems; and 
techniques for managing * interpersonal information 
management* 127]. 
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Finally the ftiamcwork should specify the relationship between 
the various application domains and appliances. We suggest 
that the relationship is not between specific appliances and 
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domains, but between domains and families of information 
appliances. 

Families of integrated personal information appliances include 
familiar technologies and appliances but also radically new 
appliances. Figure 3 shows one mapping of the space of 
famihes of personal information appliances into appUcation 
domains, and the overlapping relationships between application 
domains and families of appliances: 
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Figure 3: Personal Information Appliances 
(adapted from [20]) 



A Review of Personal Information Appliances 

Wc have discussed in general terms a framework for 
considering the development of personal information 
appliances. We are currently using this framework to drive the 
design and development of families of appliances and 
individual members of those families. We will briefly review 
some of these from the perspective of application domain 
(site/building systems), appliance family (Smartcaids and 
Telephony appliances) and user interface technology (agent- 
based appliances). 

Site and Building Systems. Except for sophisticated evaluation 
and test sices, ^intelligent* site/building management has 
predominantly been focused on environmental control, 
access/egress control and activity monitoring. The development 
of integrated personal information appliances suggests an 
integration of 'bits and buildings' and the integration of 
information appliances into sites and buildings themselves. One 
scenario is to embed information management facilities into 
buildings via distributed appliances which interface with other 
appliances, the process managed by agents which reside in each 
networked appliance. These may be PDAs, but also smaller 
appliances such as active badges, portable computers connected 
to LANs, telephone handsets or voicemail systems. Agent* 
based fax or call routing devices can direct information 
appropriately and help users manage it by tailoring messages 
(for example a room booking agent delects that activities 



cannot be interrupted, and information can be stored and/or 
forwarded to the user's future location at a specific time). 
Intelligent site/buildings and their appliances are integrated 
with wider information sources (such as proprietary networks 
or the Internet), and in-car telemadcs appliances can choose to 
direct information back to home base. 

Smartcards, For some personal information management 
activities, the point of immediate interface with information is a 
smaitcard which carries the data about the user (allowing users 
access to services such as banking, building access, public 
utility account information and payment). The issue of 
transparency is central here since users of these cards typically 
find chat several cards need to be carried as interfaces to 
different services. Considered as personal information 
appliances, these cards have the potential to act as information 
management appliances rather than merely data carriers. For 
example one form of the smartcard can provide its user with 
access to in-car telematics systems and site information; 
another is an 'electronic business card* which contains details 
of the user's business credentials (a CV. biographical 
description, photograph, details of home telephony, fax or 
voicemail systems, or native language). A user moving between 
sites, or between areas of site (when 'hotdesking' for example) 
uses the card as a transparent interface to another information 
management devices such as PDAs, telephone handsets or 
deskbound PCs. 

Telephony appliances. Telephony systems are still, despite 
massive developments in enabling network technologies, 
relatively simple and reactive information appliances. The use 
of voicemail - ubiquitous within many organisations - call 
management or fax-switching, arc familiar services which can 
be enhanced by a perspective which emphasises integrated 
personal information appliances. The requirement for 
transparency suggests that telephone handsets can be access 
points to information and enhanced with software links to 
deskbound or portable pen-driven text entry pads. PDAs, or 
smartcards. Similarly, cellular telephone handsets, which 
currently are only tenuously integrated with other appliances 
such as PCs or faxes on digital networks, can be used to access 
and manage more sophisticated information by software 
bridges to printers, faxes or displays, and can be used to 
integrate with in-car telematics systems, building/site 
information management systems and radio networks by 
docking with other appliances. 

Agent-based appliances. ^Intelligent agents* have for some time 
been a focus for work in advanced human-computer interface 
research. Sadly, such work has failed to deliver significant 
advantages. This is perhaps because the focus has been on the 
'iritelligent' in intelligent agents, rather than on the notion of 
'agency' itself. The concept of agency in terms of managing 
information may best be thought of as an enabling functionality. 
In these terms an agent may be seen as providing a special 
facility such as scheduling meetings to a particular user's 
preferences [28, 29], or performing other functions in much the 
same way as a human might. These agent roles may be viewed 
as functioning at the information level: they manage 
information within the context of human tmderstanding. A more 
appropriate approach is that information appliances host 
controllable, minimal, 'information management support 
agents*. One scenario is where agents residing in information 
appliances (faxes, telephone handsets, networks, in car- 
telematics systems or PDAs) provide low-level information 
management services such as store and forwarding of 
information based on simple preferences. Simple agents can 
populate the information space of telephony systems and help 
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users manage infonnauon through low-level communicaiion 
between building zones, providing call forwarding. Links 
between telephony and pagers to appropriately route 
information across organisations and deliver it in appropriate 
media (visual, auditory, multimedia document-based). 

Conclusion 

This paper has provided a general view of the issues in 
developing personal information appliances. It is clear that 
there are complex and difficult issues to be resolved to enable 
the development of usable appliances. Some of these are at the 
level of communications infrastructure (in terms of the efficient 
and robust integration between communications technologies 
and protocols), usaUUty (the development of effective human 
imeifaces to appliances, and the problems of ensuring a smooth 
and uniform interface representation across appliances and 
tasks) and the social (the effect of providing appliances which 
constantly sense and monitor the user's location and activities* 
for example or the effects of supporting 'informal 
communication* in the workplace - (30]). 
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